Image Processing System and Imaging Object Used for Same

ABSTRACT

An imaging technology having high reproducibility of a document and making image correction possible, without being influenced by a way of placing the document or a position of a camera, and irrespective of paper color and despite of damage of a corner portion. By printing positioning symbols on document paper in advance when the document is photographed by a digital camera or a portable phone with a camera, such as a smart phone, and by processing the image based on these positioning symbols, image processing having high reproducibility of the document and making image correction (keystone correction) possible can be implemented irrespective of paper color and even when there is damage to a corner portion of the paper.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority of theprior Japanese Patent Application No. 2010-211265, filed on Sep. 21,2010 and Japanese Patent Application No. 2011-022818, filed on Feb. 4,2011, the entire contents of which are incorporated herein by reference.

FIELD

The present invention relates to a technology effective for imaging adocument using a compact digital camera and a camera function of aportable telephone.

BACKGROUND

Compact digital cameras and digital cameras installed in portabletelephones and smartphones can now photograph high resolution imagesthat exceed several million pixels, and have begun to be frequently usednot only for photographing landscapes and portraits but also forphotographing paper documents, memorandum and business cards.

In the case of an iPhone® from Apple Inc. (registered trademark is usedbased on Aiphone Co. Ltd. licensing), several types of applicationscalled “scanner apps” are known, where a surface image of paper mediaphotographed by an integrated camera is read, edges of the paper mediaare recognized by the change of continuous pixels, and edges which arein a trapezoidal state because of being photographed diagonally arecorrected to be square (keystone correction), so that the image isfinished as if the paper media were read by a contact type documentscanner.

This technology for correcting an image of a document photographed by acamera is disclosed in Patent document 1. The technology disclosed inPatent document 1, as Claim 7 and paragraph [0047] state, is that redlines RL are created as markers along both sides of a keyboard of apersonal computer (main unit PCB), and keystone correction is performedusing a tilt angle of the red line with respect to the side edges of thescreen of the captured image as a correction parameter.

-   [Patent document 1] Japanese Patent Application Laid-Open No.    2010-130181

SUMMARY

According to Patent document 1, the keystone correction is performedbased on the red line RL markers created on both sides of the personalcomputer (main unit PCB), which are photographed in the diagonaldirection, therefore the keystone correction can be automated, which isan advantage, but a problem is that accurate keystone correction cannotbe performed unless the document is placed in front of the personalcomputer (main unit (PCB), and disposed at an accurate position withrespect to the personal computer (main unit PCB). In other words, it ishighly possible that if the document (DCM) is disposed in a diagonaldirection, even slightly, and photographed, then the document (DCM),reproduced as an image with performing the keystone correction on thistilted image, would appear deformed and unnatural.

Even if the above mentioned prior art, where the edge portion of thedocument is recognized and the keystone correction is performed, is alsoused, complicated correction calculation must be performed, and if thedocument is placed on a desk whose color is a similar shade as the paperthereof, or if a corner is damaged or curled up by staples, then therate of recognizing the edge portion drops, and in many cases thedocument cannot be reproduced accurately.

With the foregoing in view, it is an object of the present invention toprovide an imaging technology having high reproducibility of a document,without being influenced by a way of placing the document or a positionof the camera, making image correction possible even if the paper coloris similar to the table or a corner portion is damaged.

To solve the above problems, the following means are used for thepresent invention.

To be more precise, an image processing system according to the presentinvention comprises: an imaging object having positioning symbolsdisposed in at least two predetermined locations and created as symbolcodes constituted by multi-valued graphics; an imaging unit which imagesthe imaging object; an image acquisition unit which detects thepositioning symbols from the original image data imaged by the imagingunit, recognizing a predetermined area calculated based on thepositioning symbols as a first range, extracting only image dataexisting in the first range to acquire this image data as extractedimage data; and an image data storage unit which stores the extractedimage data acquired by the image acquisition unit.

According to the present invention, positioning symbols (symbol codes)are disposed on such an imaging object as a document or memorandumdirectly, so that a document image of which image correction is possibleand reproducibility is high is implemented, without being influenced bya way of placing the document or a position of the camera, even if papercolor is similar to the table or a corner portion is damaged. A symbolcode constituted by a multi-valued graphic refers to a symbol codehaving an emerging portion and a non-emerging portion. If thepositioning symbol is at two or more locations, the shape can berecognized, and if the positioning symbol is at three locations,coordinates of the image can be determined. It is preferable to disposevertex detection cells as a countermeasure for distortions duringimaging. If the positioning symbols is at four locations, the shape isknown even if the image is distorted during imaging, but the directionscannot be known, hence it is preferable to dispose an orientationsymbol.

In the image processing system according to the present invention, it ispreferable that the imaging object has an orientation symbol at apredetermined position of the first range for recognizing a direction ofthe first range, and a second range which is disposed within the firstrange or disposed as a separate area from the first range, the imageacquisition unit or the image storage unit stores character informationfor collation in advance, and the image acquisition unit recognizes thedirection of the first range based on the orientation symbol, detectsthe second range based on the recognized direction information, collatesan image drawn in the second range with the character information, andstores the characters as information related to the image data read fromthe first range if it is recognized that this image is formed ofcharacters.

According to the present invention, characters written in the secondrange can be recognized as character information and stored as therelated information for the image data read from the first range, hencethis character information can be used as an index of the image data,and retrievability of image data can be improved. A predeterminedposition in the first range refers to the top portion of the first rangeor one of the positioning symbols. The related information refers to adate, for example.

In the present invention, the character information for collation can beat least either alphabetic characters or numeric characters. By limitingthe recognition of characters written in the second range toalphanumeric characters, the recognition rate can be improved andprocessing speed can be increased.

In the image processing system according to the present invention, it ispreferable that the imaging unit reads the imaging object and transfersthe captured image to the image acquisition unit if the positioningsymbol is detected in at least three locations in the read image. Sincethe imaging unit detects the positioning symbol in at least threelocations, coordinates of the image can be determined, and since thecaptured image data is transferred to the image processing unit, anautomatic shutter can be implemented. As a result, image data can beacquired at an optimum timing without unnecessary operations by theuser.

In the image processing system according to the present invention, it ispreferable that the first range on the imaging object has a rectangularshape, and the positioning symbols are disposed in four vertexes of therectangle, respectively, and the image acquisition unit reads areference distance between the positioning symbols which is stored inadvance, collates whether the distance between the positioning symbolsin the captured image matches with the reference distance between thepositioning symbols which is stored in advance, and corrects thecaptured image such that the distance between the positioning symbols inthe captured image matches with the reference distance between thepositioning symbols if the collated result is a mismatch.

According to the present invention, the positioning symbols are disposedon such an imaging object as a document or memorandum directly, and theimage correction (keystone correction) processing is performed based onthese positioning symbols. Therefore the image data acquisition rangecan be recognized with certainty without being influenced by the way ofplacing the imaging object (direction, position, location thereof),compared with the case of recognizing the edges of a paper.

In the image processing system according to the present invention, it ispreferable that the surface of the imaging object is subjected toprinting processing so that, when the imaging object is electronicallycopied, a prohibition symbol emerges at a predetermined location havinga shape different from those at other locations, and when recognizingthe prohibition symbol in a captured image, the imaging unit which hasimaged the imaging object does not execute the processing to transferthis captured image to the image acquisition unit.

According to the present invention, the image acquisition unit does notperform image processing even if an attempt is made to image anelectronically copied imaging object, and hence illegal electroniccopying can be prevented.

The present invention can also be specified as an imaging object usedfor the image processing system according to the present invention. Inother words, the present invention is an imaging object of the imageprocessing system, and has positioning symbols disposed at least in twopredetermined locations, and created as symbol codes constituted bymulti-valued graphics.

According to the imaging object of the present invention, a positioningsymbol having a special shape is set in at least two locations (e.g.upper left and lower right), so as to clearly distinguish from suchgraphics as handwritten characters drawn in the first range, and todefine the range thereof. For the positioning symbol, positioningsymbols the same as those used for QR code (trademark registration No.4075066) may be used.

In the imaging object according to the present invention, it ispreferable that the symbol code constituted by the multi-valued graphichas an emerging portion and a non-emerging portion, the non-emergingportion has a background portion and a latent image portion havingdifferent patterns which cannot be visualized in the captured imageobtained by the imaging unit, and if the imaging object iselectronically copied and the copy is printed, the copy is reproduced ina state where the background portion and the latent image portion emergeand are visualized.

According to the present invention, the background portion and thelatent image portion which are not visualized by the imaging unit butvisibly emerge by electronic copying (copying by a copy machine) aredisposed in a graphic of a positioning symbol, and hence illegal use ofa copied imaging object can be prevented. In other words, if the imagingobject copied by an electronic copy (copying by a copy machine) isimaged, the background portion and the latent image portion of thepositioning symbol emerges, whereby the imaging unit can recognize thegraphic of the positioning symbol as a symbol having a different shape.As a result, the imaging unit cannot specify the positioning symbol andcannot transfer the captured image data to the image acquisition unit.

In the present invention, it is preferable that the imaging object has abackground portion and a latent image portion having different patternswhich are not visualized in the captured image obtained from the imagingunit, in a predetermined area excluding an area where the positioningsymbols are formed, and if this reading object is electronically copiedand this copy is printed, the prohibition symbol where the backgroundportion and the latent image portion emerge is visualized in thereproduction. By setting, in the predetermined area, the backgroundportion and the latent image portion which are not visualized by theimaging unit, but visibly emerge by electronic copying (copying by copymachine), illegal use of a copied imaging object can be prevented. Inother words, if the imaging unit detects the background portion and thelatent image portion which visibly emerges, that is, a prohibitionsymbol, the captured image data is not transferred to the imageacquisition unit, whereby illegal use can be prevented.

The present invention may be specified as an image processing system,comprising: a transparent sheet on which positioning symbols created assymbol codes constituted by multi-valued graphics are disposed in atleast two predetermined locations, and which is placed on paper servingas an imaging object; an imaging unit which images the imaging object;an image acquisition unit which detects the positioning symbols fromoriginal image data on the surface of the paper imaged by the imagingunit via the transparent sheet, recognizing a predetermined areacalculated based on the positioning symbols as a first range, andextracting only image data existing in the first range to acquire thisimage data as extracted image data; and an image data storage unit whichstores the extracted image data acquired by the image acquisition unit.

The present invention may also be specified as an image processingsystem, comprising: two or more seal pieces which are pasted onto paperserving as an imaging object, and each of which is formed of apositioning symbol created as a symbol code constituted by amulti-valued graphic; an imaging unit which images the imaging object;an imaging acquisition unit which detects the positioning symbols of theseal pieces from original image data on the surface of the paper imagedby the imaging unit, recognizing a predetermined area calculated basedon the positioning symbols as a first range, and extracting only imagedata existing in the first range to acquire this image data as extractedimage data; and an image data storage unit which stores the extractedimage data acquired by the image acquisition unit. By disposing thepositioning symbol on the transparent seal or creating the positioningsymbol as the seal piece, an image can be corrected even if such animaging object as a document and memorandum has no positioning symbols.

The present invention can also be specified as an image processingmethod. In other words, the present invention is an image processingmethod used for an image processing system, which, using an imagingunit, images the surface of an imaging object having positioning symbolsdisposed in at least two predetermined locations and created as symbolcodes constituted by multi-valued graphics, processes original imagedata thereof by an image acquisition unit and registers the processeddata in an image data storage unit, the image processing methodcomprising the steps of: the imaging unit imaging the imaging object sothat at least the positioning symbols in the at least two predeterminedlocations are included; the image acquisition unit detecting thepositioning symbols from the imaged original image data, and recognizinga predetermined area calculated based on the positioning symbols as afirst range; extracting only image data existing in the first range toacquire this image data as extracted image data; and storing theextracted image data in the image data storage unit.

The present invention can also be specified as an image processingprogram. In other words, the present invention is an image processingprogram executable by an image processing system, which, using animaging unit, images the surface of an imaging object having positioningsymbols disposed in at least two predetermined locations and created assymbol codes constituted by multi-valued graphics, processes originalimage data thereof by an image acquisition unit, and registers theprocessed data in an image data storage unit, the image processingprogram comprising the steps of: the imaging unit imaging the imagingobject so that at least the positioning symbols in the at least twopredetermined locations are included; the image acquisition unitdetecting the positioning symbols from the imaged original image data,and recognizing a predetermined area calculated based on the positioningsymbols as a first range; extracting only image data existing in thefirst range to acquire this image data as extracted image data; andstoring the extracted image data in the image data storage unit.

The present invention may be specified as an imaging object which isimaged by an imaging unit, and is used for an image processing systemwhich processes the image data by an image acquisition unit and storesthe data in a data storage unit, the imaging object comprising:positioning symbols which are disposed in at least two predeterminedlocations for determining an imaging range of the imaging object, andare created as symbol codes constituted by multi-valued graphics; and afirst range which is disposed in a predetermined position based on thepositioning symbols so that the image acquisition unit extracts imagedata.

In the imaging object according to the present invention, it ispreferable that an imaging object has: an orientation symbol at apredetermined location of the first range for recognizing a direction ofthe first range; and a second range which is disposed within the firstrange or disposed as a separate area from the first range, and in whichcharacters are written, so as to recognize a direction based on thepositional relationship with the orientation symbol, and collate withthe character information for collation stored in the image data storageunit in advance.

The present invention can also be specified as an image processingsystem used via a network, comprising: an imaging object havingpositioning symbols disposed in at least two predetermined locations andcreated as symbol codes constituted by multi-valued graphics; an imagingunit for imaging the imaging object; a transmission unit which transmitsoriginal image data imaged by the imaging unit via a network; an imageacquisition unit which, in an image processing server which receives theoriginal image data via the network, detects the positioning symbolsfrom the original image data imaged by the imaging unit, recognizing apredetermined area calculated based on the positioning symbols as afirst range, extracting only image data existing in the first range toacquire this image data as extracted image data; and an image datastorage unit which stores the extracted image data acquired by the imageacquisition unit.

The present invention can provide an imaging technology having highreproducibility of a document, without being influenced by a way ofplacing the document or a position of a camera, making image correctionpossible even if the paper color is similar to the table or a cornerportion is damaged.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram depicting a memo paper serving as an imaging objectaccording to an embodiment, (1);

FIG. 2 is a diagram depicting a memo paper serving as an imaging objectaccording to an embodiment, (2);

FIG. 3 is a diagram depicting a memo paper serving as an imaging objectaccording to an embodiment, (3);

FIG. 4 is a diagram depicting a configuration of a smart phone with acamera used for the embodiment;

FIG. 5 is a diagram depicting a case of using the embodiment in anetwork;

FIG. 6 is a flow chart depicting an example of the processing accordingto the embodiment;

FIG. 7 is a diagram depicting a photographing state and a transparentplate on which positioning marks are printed according to theembodiment;

FIG. 8 is a diagram depicting a memo paper serving as an imaging objectaccording to an embodiment, (4);

FIG. 9 is a diagram depicting a seal on which a positioning mark isprinted used for the embodiment; and

FIG. 10 is a flow chart depicting another example of processingaccording to the embodiment.

DETAILED DESCRIPTION OF EMBODIMENTS Embodiment 1

The present invention will now be described with reference to thedrawings. FIG. 1 shows a configuration of the surface of a memo paper(imaging object) (DOC) according to the present embodiment. As FIG. 1shows, this memo paper (DOC) has a binding margin (US) created at theupper portion, and a paper main portion. In the top area of the papermain portion, a perforation (ML) is created in the horizontal directionin FIG. 1 along the binding margin (US), so that the memo paper mainportion can be detached.

Positioning symbols (M1 to M4) are printed on the surface of the memopaper main portion in areas near the four corners. Out of the fourpositioning symbols, the positioning symbols at the upper left (M1),lower left (M2) and lower right (M3) correspond to a symbol codeconstituted by a multi-valued graphic according to the presentinvention, and is a square (emerging portion) which is filled and isenclosed by a ground color portion (non-emerging portion) of the whitepaper, is disposed inside a square bold line form (emerging portion).This bold line form is preferably printed with a line thicker thangeneral writing instruments (pencils, ball point pens, felt tip pens) soas to be clearly distinguishable from handwriting written with writinginstruments in the later mentioned first range. The positioning symbolmay be a color code.

An orientation symbol (M4), of which shape is different from the abovementioned positioning symbol, is printed at the upper right of the papermain portion. The orientation symbol (M4) corresponds to a symbol codeconstituted by the multi-valued graphic according to the presentinvention, and has a shape that is different from positioning symbols atthe upper left (M1), lower left (M2) and lower right (M3). By making theshape of only one of the four symbols to be different from the others,the correct direction of the memo paper (DOC) can be detected whenimaged by a camera (CAM).

The area surrounded by the four positioning symbols (M1 to M4) is afirst area (AR1), where the user can draw handwritten characters,graphics, symbols and pictures. The image in the first range (AR1) iswritten as original image data.

In this example, the first range (AR1) is recognized as a portionsurrounded by the four positioning symbols (M1 to M4), but the number ofpositioning symbols which are disposed need not be four, but may be two,only at the upper left (M6) and the lower right (M7), as shown in FIG.3. In other words, a rectangular area of which diagonal line is a lineconnected the upper left positioning marker (M6) and the lower rightpositioning marker (M7) may be recognized as the first range (AR1).

In the above description, the shape of the upper right symbol, out ofthe four positioning symbols (M1 to M4), is changed to be theorientation symbol, but the orientation symbol may be printed in alocation other than the positioning symbols (M1 to M4), as shown by M5in FIG. 1 and FIG. 2.

A second range (AR2) may be recognized based on the relative positionalrelationship between the positioning symbol (M1) and the positioningsymbol (M2). The second range (AR2) may be recognized based on therelative positional relationship between the positioning symbols and theorientation symbol, instead of the relative positional relationshipbetween positioning symbols. In the case of the example shown in FIG. 3,the second range (AR2) may be recognized based on the binding margin(US).

In FIG. 1, the second range (AR2) is disposed at the left area near theorientation symbol (M4) in the first range (AR1). The second range (AR2)has a height the same as the height of the orientation symbol, and sincethe left side edge of the orientation symbol (M4) matches with the rightside edge of the second range, the second range can be detected if theorientation symbol (M4) is detected based on the original image dataimaged by the camera (CAM).

In the second range, an entry guide, which is a straight line piececonstituting seven segments, is printed with a light color, as shown inFIG. 3, although FIG. 1 does not illustrate details. In other words, bytracing the entry guide portion constituting the seven segments using awriting instrument, a numeric character from 0 to 9 can be written ineach segment, just like the numeric display of an electric scoreboard.

By creating the seven segments of the entry guide, the recognition rateof the entered numeric characters can be increased. The above is anexample of disposing seven segments of the entry guide to make it easierto recognize entered numeric characters, but the present invention isnot limited to this, and a frame may be printed with a light color foreach character so as to recognize a numeric character or alphabeticcharacter written in this frame. In other words, by reading thecharacters (alphanumeric) entered in the second range (AR2) with acamera (CAM), and comparing the characters with character patterns(character information for collation) stored in memory (MEM), characterrecognition can be performed.

As FIG. 2 shows, a prohibition symbol (AS1) is disposed immediatelybelow the orientation symbol (M4) on the memo paper (DOC). Thisprohibition symbol is printed in a way visually unrecognizable, byground tint printing for example, and appears as a visible prohibitionsymbol when the memo paper is electronically copied using a copy machineor the like. The prohibition symbol is located in a predeterminedposition in the first range (AR1), and can be located in a positionimmediately above the lower left positioning symbol (M2), as shown inFIG. 2, for example.

The ground tint printing emerging (visualized) may be activelyrecognized as a prohibition symbol by a program. When the presence ofthe prohibition symbol on the memo paper (DOC) is recognized, thecentral processing unit (CPU) may stop image processing according to aprogram, and such a message as “This paper is not standard paper” may bedisplayed on a display (DISP).

Now a hardware configuration of a smartphone with a camera (MP) used forthe present embodiment will be described with reference to FIG. 4. Thissmartphone (MP) is an iPhone® of Apple Inc. (registered trademark usedbased on Aiphone Co. Ltd. licensing), for example.

The main body of the smartphone has a home button (BTN), which functionsto return icons and menus displayed on the display (DISP) to a homescreen, or functions as a shutter of a camera (CAM).

The smartphone (MP) encloses a central processing unit (CPU) along witha main memory (MM), a memory unit (MEM) connected via a bus (BUS), acommunication interface (TIF), the camera (CAM), the button (BTN), atouch panel display where a touch panel (TPN) and a display (DISP) areintegrated, and a speaker (SPK).

As FIG. 5 shows, the communication interface (TIF) can be connected to astandard network (NW) via a base station (BS) through a wirelesstelephone connection. This communication interface (TIF) can communicatewith an access point (AP) of a wireless LAN, and can be connected to anetwork via any communication means.

In the memory unit (MEM), an image processing application program (APL),and a user data area (UDT) for holding the original image data andcharacter information, are disposed along with the operating system(OS).

According to the present embodiment, capturing an image of the memopaper (DOC) and image processing thereof are implemented by the centralprocessing unit (CPU) reading an image processing application program(APL) of the memory unit (MEM) via the bus (BUS) and the main memory(MM), and sequentially executing the program. This processing will nowbe described based on the processing flow in FIG. 6.

When the image processing application program (APL) is selected andstarted up by a user touching the touch panel (TPN) (step 601), thecamera (CAM) function is activated, a memo paper (DOC), which is animaging object, is photographed, and the central processing unit (CPU)reads this captured image based on the program, and determines whetherthe prohibition symbol described in FIG. 2 is present (step 603). Thepresence of a prohibition symbol is determined by reading the image dataof the prohibition symbol to be the reference, which is recorded in thememory unit, and comparing this image with the original image data fromthe camera (CAM).

If the prohibition symbol is detected here, processing returns to step602, without executing subsequent steps. In this case, such a message as“This paper is not standard paper” may be displayed on the display(DISP), as mentioned above, in order to notify the detection of theprohibition symbol to the user.

If the prohibition symbol is not detected, the central processing unit(CPU) searches the positioning symbols in the original image data (step604). This search of the positioning symbols is also executed by readingthe image data of the positioning symbols to be a reference, which isrecorded in the memory unit, and comparing the image data with theoriginal image data from the camera (CAM).

If the positioning symbols are detected, the original image data issaved in the memory unit (MEM) at this stage (step 605). A shutter soundmay be output from the speaker (SPK) in order to notify the decision touse the original image data at this time. Even if the positioningsymbols are not recognized in step 604, a shutter sound may be generatedby the user operating the button (BTN) (step 611) to save the originalimage data at this point in the memory unit (MEM), and continuesearching the positioning symbols (step 612). In this case as well, ifthe positioning symbols cannot be detected for a predetermined time, theuser may be allowed to select to either hold the original image data asis, or return to step 602 and photograph the memo paper again (step613).

If the original image data is held in step 605, the number ofpositioning symbols is counted (step 606). If only three positioningsymbols have been detected, the remaining one positioning symbol isestimated based on the three positions, and the fourth positioningsymbol (dummy) is additionally set (step 610).

When all four positioning symbols (M1 to M4) are determined, the fourvirtual lines connecting the edges of the four positioning symbols areset, and the portion enclosed by the virtual lines in the image isextracted as a first range (step 607).

Then keystone correction is performed on the extracted image so that thepositions and distances of the four sides match with the referencepositions and distances stored in the memory unit in advance (step 608),and the corrected image is saved in the memory unit (MEM) as thereproduced image of the memo paper (DOC) (step 609).

In FIG. 6, processing in the case of the prohibition symbol (AS1) beingdisposed immediately below the orientation symbol (M4) of the memo paper(DOC) or immediately above the lower left positioning symbol (M2) wasdescribed. The prohibition symbol, however, may be disposed in anon-emerging portion (white background portion) of a positioning symbol(e.g. M3) by ground tint printing, as shown in FIG. 2. The prohibitionsymbol may be disposed in a non-emerging portion (white backgroundportion) of another positioning symbol (e.g. M3) by ground tintprinting. If the positioning symbol (M3) and prohibition symbol (AS3)are superimposed and printed like this, and if the memo paper (DOC) iselectronically copied by a copy machine, the positioning symbol (M3) ofthe copy has a different shape from the other positioning symbols, hencethe central processing unit (CPU) performs processing to not recognizethis positioning symbol as the positioning symbol (M3) by a program whenthe image processing is performed after the image is read by the camera(CAM). After this, the processing of the original image data in thefirst range may not be executed.

If the prohibition symbol is disposed in the non-emerging portion (whitebackground portion) of the positioning symbol by ground tint printing,it is not necessary to recognize the prohibition symbol. Therefore theimaging and image processing can be performed based on the processingflow shown in FIG. 10. A difference of the processing shown in FIG. 10from the processing flow in FIG. 6 is that processing to search thepositioning symbols (step 1004) is executed without executing theprocessing for determining the presence of the prohibition symbol (step603) in FIG. 6. The last two digits of the reference numeral in eachstep in FIG. 10 correspond to the last two digits of each step in FIG.6, and it is assumed that the same processing is performed in steps ofwhich last two digits of the reference numeral are the same.

In the above mentioned processing flow, an example of executing thekeystone correction using all four positioning symbols was described,but the present invention is not limited to this, and as described inFIG. 3, the keystone correction may be executed using only the upperleft positioning symbol (M6) and the lower right positioning symbol (M7)as references. In this case, only two positioning symbols are detectedin step 606. For the remaining two positioning symbols, dummypositioning symbols may be set by estimating the positions thereof.

In the above description, the case of executing every processing using asmartphone (MP) was described, but a server (SV) connected via thenetwork (NW) may execute a part of the processing.

For example, after the memo paper (DOC) is photographed by the camera(CAM), the original image data is saved in the memory unit (MEM) once,then is transmitted to the server (SV) via the communication interface(TIF) and the network (NW).

The server (SV) which received the original image data detects thepositioning symbols in the original image data based on the imageprocessing program stored in the server, recognizes a predetermined areacalculated based on the positioning symbols as the first range, extractsonly the image data existing in the first range, and stores the imagedata in the server (SV) as the extracted image data.

The image data stored in the server (SV) may be accessed from thesmartphone (MP) via the network (NW).

In the above description, the example of directly printing thepositioning symbols and orientation symbol on the memo paper (DOC) wasdescribed, but the present invention is not limited to this, and thepositioning symbols and orientation symbol may be printed on atransparent plastic sheet (PL), or seals, on which the positioningsymbols and orientation symbol are printed, may be pasted thereon, sothat the plastic sheet (PL) is placed on the memo paper (DOC) and thesurface of the memo paper (DOC) is photographed in this state by thecamera (CAM) through the plastic sheet.

Seals (SL) created as plastic films on which the positioning symbols andorientation symbol are printed, as shown in FIG. 9, having the adhesivesurfaces created on the rear face of a seal (SL) may be provided so asto be pasted on a standard memo paper and report paper.

In the above description, the imaging object was described as the memopaper (DOC), but any paper size can be used as long as the positioningsymbols and orientation symbol can be set, such as a A4 size reportpaper, white paper, a printed document, a business card or a businesscard sized memo paper.

The present invention can be used for the image processing field wheredocuments are photographed without contact using a camera.

What is claimed is:
 1. An image processing system, comprising: animaging object having positioning symbols which are disposed in at leasttwo predetermined locations, and are created as symbol codes constitutedby multi-valued graphics; an imaging unit which images the imagingobject; an image acquisition unit which detects the positioning symbolsfrom original image data imaged by the imaging unit, recognizing apredetermined area calculated based on the positioning symbols as afirst range, and extracting only image data existing in the first rangeto acquire this image data as extracted image data; and an image datastorage unit which stores the extracted image data acquired by the imageacquisition unit.
 2. The image processing system according to claim 1,wherein the imaging object has an orientation symbol at a predeterminedlocation of the first range for recognizing a direction of the firstrange, and a second range which is disposed within the first range ordisposed as a separate area from the first range, the image acquisitionunit or the image storage unit stores character information forcollation in advance, and the image acquisition unit recognizes thedirection of the first range based on the orientation symbol, detectsthe second range based on the recognized direction information, collatesan image drawn in the second range with the character information, andstores the characters as information related to the image data read fromthe first range if it is recognized that this image is formed ofcharacters.
 3. The image processing system according to claim 1, whereinthe imaging unit reads the imaging object and transfers the capturedimage to the image acquisition unit if the positioning symbols aredetected at a plurality of locations in the read image.
 4. The imageprocessing system according to claim 1, wherein the first range on theimaging object has a rectangular shape, and the positioning symbols aredisposed in four vertexes of the rectangle, respectively, and the imageacquisition unit reads a reference distance between the positioningsymbols which is stored in advance, collates whether the distancebetween the positioning symbols in the captured image matches with thereference distance between the positioning symbols which is stored inadvance, and corrects the captured image such that the distance betweenthe positioning symbols in the captured image matches with the referencedistance between the positioning symbols if the collated result is amismatch.
 5. The image processing system according to claim 1, whereinthe surface of the imaging object is subjected to printing processing sothat, when the imaging object is electronically copied, a prohibitionsymbol emerges at a predetermined location having a shape different fromthose at other locations, and when recognizing the prohibition symbol ina captured image, the imaging unit which has imaged the imaging objectdoes not execute the processing to transfer this captured image to theimage acquisition unit.
 6. An image processing system, comprising: atransparent sheet on which positioning symbols created as symbol codesconstituted by multi-valued graphics are disposed in at least twopredetermined locations, and which is placed on paper serving as animaging object; an imaging unit which images the imaging object; animage acquisition unit which detects the positioning symbols fromoriginal image data on the surface of the paper imaged by the imagingunit via the transparent sheet, recognizing a predetermined areacalculated based on the positioning symbols as a first range, andextracting only image data existing in the first range to acquire thisimage data as extracted image data; and an image data storage unit whichstores the extracted image data acquired by the image acquisition unit.7. An image processing system, comprising: two or more seal pieces whichare pasted onto paper serving as an imaging object, and each of which isformed of a positioning symbol created as a symbol code constituted by amulti-valued graphic; an imaging unit which images the imaging object;an imaging acquisition unit which detects the positioning symbols of theseal pieces from original image data on the surface of the paper imagedby the imaging unit, recognizing a predetermined area calculated basedon the positioning symbols as a first range, and extracting only imagedata existing in the first range to acquire this image data as extractedimage data; and an image data storage unit which stores the extractedimage data acquired by the image acquisition unit.
 8. An imageprocessing system established via a network, comprising: an imagingobject having positioning symbols disposed in at least two predeterminedlocations and created as symbol codes constituted by multi-valuedgraphics; an imaging unit which images the imaging object; atransmission unit which transmits original image data imaged by theimaging unit via a network; an image acquisition unit which, in an imageprocessing server which receives the original image data via thenetwork, detects the positioning symbols from the original image dataimaged by the imaging unit, recognizing a predetermined area calculatedbased on the positioning symbols as a first range, extracting only imagedata existing in the first range to acquire this image data as extractedimage data; and an image data storage unit which stores the extractedimage data acquired by the image acquisition unit.
 9. An imageprocessing method used for an image processing system which images,using imaging unit, the surface of an imaging object having positioningsymbols disposed in at least two predetermined locations and created assymbol codes constituted by multi-valued graphics, processes originalimage data thereof by image acquisition unit and registers the processeddata in image data storage unit, the image processing method comprisingthe steps of: the imaging unit imaging the imaging object so that atleast the positioning symbols in the at least two predeterminedlocations are included; the image acquisition unit detecting thepositioning symbols from the imaged original image data, and recognizinga predetermined area calculated based on the positioning symbols as afirst range; extracting only image data existing in the first range toacquire this image data as extracted image data; and storing theextracted image data in the image data storage unit.
 10. Anon-transitory, a computer readable storage medium storing an imageprocessing program for an image processing system which images, using animaging unit, the surface of an imaging object having positioningsymbols disposed in at least two predetermined locations and created assymbol codes constituted by multi-valued graphics, processes originalimage data thereof by an image acquisition unit, and registers theprocessed data in an image data storage unit, the image processingprogram comprising instructions for executing the steps of: the imagingunit imaging the imaging object so that at least the positioning symbolsin the at least two predetermined locations are included; the imageacquisition unit detecting the positioning symbols from the imagedoriginal image data, and recognizing a predetermined area calculatedbased on the positioning symbols as a first range; extracting only imagedata existing in the first range to acquire this image data as extractedimage data; and storing the extracted image data in the image datastorage unit.
 11. An imaging object used for an image processing systemwhich includes: an imaging unit which images an imaging object havingpositioning symbols; an image acquisition unit which detects thepositioning symbols from original image data imaged by the imaging unit,recognizing a predetermined area calculated based on the positioningsymbols as a first range, extracting only image data existing in thefirst range to acquire this image data as extracted image data, andcorrecting the extracted image data based on a distance between thepositioning symbols; and an image data storage unit which stores theextracted image data acquired by the image acquisition unit, the imagingobject comprising: a rectangular paper main portion; and the positioningsymbols which are disposed in at least two locations out of areas nearfour corners of the paper main portion, and are created as symbol codesconstituted by multi-valued graphics, wherein each of the positioningsymbols has an emerging portion having a color value that is differentfrom a ground color of the paper main portion and a non-emerging portionhaving the ground color of the paper main portion, and the emergingportion at least includes an emerging portion having straight lineportions and a corner portion, being two straight line portionsrespectively parallel with two sides extending from a corner of thepaper main portion and a corner portion where edges of the two straightline portions contact each other, and a rectangular emerging portionwhich is located inside the emerging portion having the straight lineportions and the corner portion, and the non-emerging portion is an areabetween the emerging portion having the straight line portions and thecorner portion and the rectangular emerging portion.
 12. The imagingobject according to claim 11, wherein the positioning symbols aredisposed in areas near the four corners of the paper main portionrespectively, and one of, the four positioning symbols is an orientationsymbol of which shape is different from those of the other threepositioning symbols.
 13. The imaging object according to claim 11,wherein the positioning symbols are disposed so that the distancebetween the positioning symbols matches with a reference distancebetween the positioning symbols which is stored in the image acquisitionunit in advance, and the imaging object further comprises a first rangedelimited by the positioning symbols.
 14. The imaging object accordingto claim 11, wherein the paper main portion further includes a secondrange constituted by seven segments of an entry guide.
 15. The imagingobject according to claim 11, wherein the paper main portion issubjected to printing processing so that, when the paper main portion iselectronically copied, a prohibition symbol emerges at a predeterminedlocation having a shape different from those at other locations.
 16. Theimaging object according to claim 11, wherein the non-emerging portionhas a background portion and a latent image portion having differentpatterns which are not visualized by the imaging unit, but visiblyemerge by electronic copying.
 17. The imaging object according to claim11, having a background portion and a latent image portion havingdifferent patterns which are not visualized by the imaging unit, butvisibly emerge by electronic copying, in a predetermined area excludingan area where the positioning symbols are formed.
 18. The imaging objectaccording to claim 12, further comprising a second range, which isdisposed within the first range or disposed as a separate area from thefirst range, and of which direction is recognized by a positionalrelationship with the orientation symbol, and which is constituted by arange where characters for collating with character information forcollation stored in the image data storage unit in advance are written.19. An imaging object used for an image processing method which includesthe steps of: imaging an imaging object having positioning symbols;detecting the positioning symbols from imaged original data; recognizinga predetermined area calculated based on the detected positioningsymbols as a first range, extracting only image data existing in therecognized first range to acquire this image data as extracted imagedata; correcting the extracted image data based on a distance betweenthe positioning symbols; and storing the extracted image data, theimaging object comprising: a rectangular paper main portion; and thepositioning symbols which are disposed in at least two locations out ofareas near four corners of the paper main portion, and are created assymbol codes constituted by multi-valued graphics, wherein each of thepositioning symbols has an emerging portion having a color value that isdifferent from a ground color of the paper main portion and anon-emerging portion having the ground color of the paper main portion,and the emerging portion at least includes an emerging portion havingstraight line portions and a corner portion, being two straight lineportions respectively parallel with two sides extending from a corner ofthe paper main portion, and a corner portion where edges of the twostraight line portions contact so that the two lines are perpendicularto each other, and a rectangular emerging portion which is locatedinside the emerging portion having the straight line portions and thecorner portion, and the non-emerging portion forms an area between theemerging portion having the straight line portions and the cornerportion and the rectangular emerging portion.